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Rob Kass presents a fascinating vision of a "post"- 
Bayes/frequentist-controversy world in which prac- 
tical utility of statistical models is the guiding prin- 
ciple for statistical inference. I agree with Kass on 
many points. In particular, Kass is correct (in my 
opinion) when he notes that much modern statisti- 
cal work develops statistical models (the theoretical 
world) and asks whether the models provide a rea- 
sonable description or explanation of data (the real 
world). A recent example in my own collaborative 
work (Scharenbroich et al., 2009) builds a storm 
tracking model that combines subjective informa- 
tion from climate scientists about storms in the east- 
ern Pacific and historical data to develop a proba- 
bilistic model that appears to fit data well. A critical 
element of this approach, as Kass notes, is that we 
understand the assumptions that underlie our sta- 
tistical model and, equally important, that we sub- 
ject these assumptions to careful scrutiny. I continue 
to find posterior predictive model checks (Gelman, 
Meng and Stern, 1996) especially helpful for asses- 
sing model fit. 

Of course, this would not be a particularly inter- 
esting discussion if it focused on points of agreement. 
I believe that Kass's proposed "big picture" fails at 
one key goal that we should have for such a picture — 
it does not easily illustrate one of the key concepts of 
the field, the art of generalizing from sample data to 
larger populations. I argue below that the "old" big 
picture (Kass's Figure 3) still has great value for me 
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and for the field. I also speculate a bit about prag- 
matism as a foundation on which to build a training 
program for statisticians. 

IN DEFENSE OF THE "OLD" BIG PICTURE 

My main disagreement with Kass concerns his dis- 
satisfaction with his Figure 3 and the story that it 
tells. According to Kass, the figure, which describes 
inference as drawing conclusions about a population 
from a sample of that population, "is not a good gen- 
eral description of statistical inference"; he prefers 
his Figure 1. When it comes to teaching introduc- 
tory students, I much prefer the old figure. The sta- 
tistical or quantitative literacy that I would love for 
my introductory students to develop (and bring into 
the world with them) does emphasize statistical in- 
ference as the process of learning about populations 
from samples. Understanding the importance of the 
inference question posed in this way will help non- 
statisticians ask whether a study of memory in col- 
lege sophomore psychology students provides suffi- 
cient insight to allow one to generalize to the U.S. 
population as a whole or whether a medical study 
associating a particular risk factor with disease is 
based on a sufficiently representative sample. When 
I meet with scientists on campus the starting point 
is not the methodology but the scientific question 
and how to design a study that will inform about 
that question. The question of how to obtain repre- 
sentative data is an important one and many studies 
suffer when insufficient attention is paid to this basic 
point at the start of a study. When I am asked about 
statistics by people outside the University, ranging 
from middle school and high school students to my 
in-laws and the occasional taxicab driver, I tell them 
about how we use samples to learn about popula- 
tions rather than about building theoretical models 
of the real world. 

The "old" big picture (Figure 3) is also an ac- 
curate reflection of the world of survey sampling 
which plays a major role in the collection of data 
that drives public policy. Survey sampling may not 
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be a major part of the statistical toolkit for the sci- 
entific collaborations discussed by Kass but it re- 
mains a critical function of the discipline. I would 
prefer future politicians learn about survey sampling 
and statistical inference from the traditional pic- 
ture than about alternative binary regression mod- 
els from the new big picture. Just this summer the 
Canadian government proposed making their Cen- 
sus long form optional — I would sure like for people 
to easily grasp why that is problematic. I believe 
they would see the problem from Figure 3 or at 
a minimum that the problem is easily described by 
referring to that figure. Is the problem with optional 
survey response clear in Figure 1 (or even Figure 4)? 
I suppose the point could be made more general: 
Kass's Figure 1 does not talk at all about where 
the data (the sample) come from. We know this is 
a critical question. 

Kass is correct in pointing out that the popula- 
tion/sample picture is limiting. There are many sit- 
uations for which that big picture fails. It is hard 
to tell a compelling regression story with that pic- 
ture or to address the Hecht et al. psychophysical 
experiment featured by Kass. It is at this point that 
the statistical models that inhabit Kass's theoret- 
ical world enter as a very useful way to proceed. 
When the time comes in my introductory course 
that the old picture fails to be relevant I introduce 
the concepts in Kass's Figure 1. In fact, I like Kass's 
Figure 1 and can easily imagine integrating it as 
the "second" big picture that I show my students. 
One can even point out to more advanced students 
(statistics majors, statistics graduate students) that 
in the majority of modern interdisciplinary scien- 
tific collaborations it is the "new" big picture that 
reflects how we proceed once we have collected the 
data. 

PRAGMATISM AS A FOUNDATION 

Beyond my concerns about whether pragmatism is 
appropriate for introductory students and for teach- 
ing basic quantitative literacy, I also wonder what 
implications statistical pragmatism has for our grad- 
uate training programs. Would we teach Bayesian 
inference as merely a set of tools for the pragma- 
tist to draw upon when appropriate? How much 
time should we spend talking about subjective prior 
distributions? Although Kass starts his abstract by 



noting that "Statistics has moved beyond the fre- 
quentist-Bayesian controversies of the past," I sus- 
pect there might be considerable disagreement about 
curricular issues such as these. I worry more broadly 
that pragmatism might appear to reinforce the no- 
tion of statistics as a set of techniques that we "pull 
off the shelf" when confronted with a data set of 
a particular type. I certainly do not believe that is 
the intent of the philosophy described here; in fact I 
am quite certain that Kass is not in favor of such an 
approach. My question then is how do we develop 
students into the kind of science-based statistical 
pragmatists that Kass would like to see. I do not see 
pragmatism itself as providing us with the prescrip- 
tion for how to get there. Indeed, Kass's pragmatism 
seems to be a fairly evolved state for a statistician; 
it seems to require a clear understanding of the var- 
ious competing foundational arguments that have 
preceded it historically. 

CONCLUSION 

Statistical pragmatism appears to me to be an ac- 
curate description of the practices of many modern 
statisticians. In that regard I appreciate Rob Kass's 
contribution to starting a discussion about what we 
mean by statistical pragmatism and what its impli- 
cations are for teaching introductory students and 
graduate students about statistical inference. I am 
concerned that pragmatism as presented here fails to 
get at key points regarding data collection and sam- 
pling that are essential to both professional statis- 
ticians' and the general population's understanding 
of inference. 
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